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Abstract 

We show that for a large class of marked point processes there exists a 
random measure m with the predictable representation property such that 
iterated integrals with respect to m span the space of square integrable 
random variables. 

1 Introduction 

A fundamental result in the stochastic analysis on Wiener spaces is the Wiener- 
Ito chaos representation theorem [ID] . This theorem allows the representation of 
any square integrable random variable as the sum of iterated stochastic integrals 
with respect to the underlying Wiener process, and provides an approach to 
the Malliavin calculus of variations. Such a representation is often termed a 
chaos representation, and is closely linked to representations in terms of Hermite 
polynomials. 

For processes with jumps, it is also possible to construct a theory of chaos 
expansions. This has been studied in the context of Markov chains in Kroeker 
[5] (see also Biane [T]) and for the Binomial process in Privault and Schoutens 
[S]. In these works, the approach is based on the principle of finding an ana- 
logue to the Hermite polynomials appropriate to these spaces. Emery [7] studies 
chaos representations in terms of iterated integrals, assuming that the under- 
lying martingale satisfies a certain structure condition, related to the Azema 
martingale. Many authors have since expanded on these ideas. 

In this paper we give a general approach to chaos decompositions for an 
arbitrary marked point process, where we simply assume that the compensat- 
ing measure for the underlying process is absolutely continuous (in both time 
and space) with respect to some (locally finite in time) deterministic measure. 
Instead of searching for a polynomial chaos interpretation, we focus on the rep- 
resentation in terms of iterated stochastic integrals with respect to fundamental 
martingales. For this, we use the fundamental martingales constructed in Elliott 
[3] and Davis [5] , which make no assumptions about independence of the incre- 
ments. In such a setting, we shall show that the iterated stochastic integrals 
span the entirety of L?{J-). 

This result complements the construction of the Malliavin calculus for Marked 
Point Processes as in Decreusefond [3 , Section 4]. In [3 it is simply assumed that 
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the space under consideration admits a chaos decomposition. The contribution 
of this paper is to show general conditions under which this is the case. 



2 Martingales for Marked Point Processes 

We begin by constructing an exphcit martingale representation result. We do 
this mainly for copleteness, in Section 2] we shall simply assume that some 
martingale representation is given, which may or may not be the one constructed 
here. 

The setting for this analysis is taken from Elliott [4] (see also Davis [2] , and 
Elliott [5]), we shall state relevant results without proof or further reference. 
For a simpler and more gentle introduction to this style of analysis for marked 
point processes, see [51, Ch. 17]. 



2.1 The jump setting 

Let {E, 6) be a Blackwell space. Consider a right-constant jump process X 
taking values in E, which is initially in the fixed position Xq = € E. 

At a random time Ti, X jumps to a random location ^ ^o, at which it 
stays until a random time T2, when it jumps to a random location ^2 7^ £.1, 
etc... As X is right-constant, we know that for each path, the jumps Ti are 
well ordered, and there are at most countably many jumps. For simplicity, in 
this paper we shall assume that there are at most finitely many jumps on any 
compact, that is, lim„^oo Tn = 00 for (almost) all paths. 

We then have a measurable space where T — <7{Xs,s < 00}, and 

C ([0,00] X E)^^ is a list of all the jump times and locations of X, with 
the property that X can only jump once at each time, and must jump to a 
new location. We suppose a probability measure P is given on this space. We 
denote by J^t the P-completed tr-algebra generated by X up to time t, that is 
Tt = (j{Xs; s < t} V {null sets}. This space will be kept fixed throughout the 
paper. 



2.2 Fundamental martingales 

Suppose Tq, a e N is a jump time. The distribution of the pair (Ta,^a) given 
J-^Ta-i is described by a random measure (that is, a regular family of conditional 
probability distributions) /i"(w; •) on [0,oo] x E. Properties of /i" are given in 
[5]. Define 

(w; A) = ^"(a;;]i,oo] x A) 

so that, omitting lo for notational convenience, F"{A) is the conditional proba- 
bility that Ta > t and G A given Ft^_^. For convenience :— F^{E) and 
we write 

dF"{A) 



X^it.A) 



dF°'{E) 
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the rate at which the ath jump is into A at time t. We can then define the 
stochastic processes 

p"{t,A) :=It>TJs^eA 

r{t,A):=-f {F^_)-'dF:{A) = - [ A«(s,A)(F«_)-idF« 

J]0,tAT„] J]0,tATa,] 

q'^{t,A) :=p'^{t,A)-p^{t,A) 
so that q°'{t,A) is an J^j-martingale with predictable quadratic variation 

(,",M)>=^"(M)- E M<^. 

0<u<tAT„ ^ "-'^ 

We shall sec that these martingales provide a basis from which we can obtain a 
martingale representation theorem in these spaces. Note that is simply the 
compensator of the finite variation process p", and q"' is then the martingale 
part of p". Note also that if p" is continuous in t, then A°'{t,A)AF°' = 0, and 
{q"{t,A)) =p"(t,A). 

Write G" for the set of measurable functions {g" : Cl x [0, oo] x E ^ R} such 
that for each {t,x) € [0,T] x E, g" is J^t„_i -measurable. As for fixed a,t and 
w we know A) and A) are both countably additive in A, for suitable 
ga g Qa have 

/ 3«(s,:rK(ds,da;)=5"(r„,x„) 

/ g^{s,x)p-{ds,dx) = - [ [ g»{s,x)X"{w;s,dx)^ 

Lemma 1. For any square-integrable martingale M, we define 

AM" :=Mt, -Mt,-i- 
Then for every a €N, we have 

This leads to a precursor to the martingale representation result in this 
context. 

Theorem 1. Suppose M is a square-integrable martingale; write 

Then for each a G N, there exists a function <?" G G" such that 



= ( g°'{s,x)q"{ds,dx) a.s. 

J]0,t]xE 



We shall say that represents iV". Furthermore, g°'{Ta,Xa) = ^-^t„? ''^P ^'^ 
the addition of a J^t„_^ -measurable random variable. 
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3 Martingale representation theorem 



We now depart from the presentation of the martingale representation theorem 
in [5], to present a shght variant which more naturally leads to the chaos rep- 
resentation, and is of a more familiar form. Our presentation depends on the 
following lemma and associated definition. 

Lemma 2. For each uj, any t, any A € £, p'^{^] t, A) and p"'{uJ] t, A) vary in t 
only on the set t E:]Ta-i,Ta]- In particular, the measures {dp"} a(^i on[0,oo]xE 
have disjoint supports, and similarly for {dp^jaej- 
Therefore, we can define the disjoint sum 

p{u!;dt,dx) = p" {uj; dt, dx), 

and similarly for p and hence for q ~ p — p. 

Corollary 1. Let g"' he as in Theorem]^ Let g°' he defined as 

g"{t,x) ^ I{te]T^^uT^]}9"{t,x) 
Then g" also represents N"' 

Proof. This follows as we have only modified g" off the support of . □ 

We can now state our first martingale representation theorem. 

Theorem 2. Let M be a square-integrahle {J- 1} -martingale. Then there exists 
an {J-t}-predictahle process g{t,x) such that 

Mt = Afo + / g{t, x)q{dt, dx). 

J]0,t]xE 

Proof. Let g" be as in Corollary [T] By Lemma [T] and the fact g" represents iV", 
we have 

Mt - Mo = V A^f = V / x)q{ds, dx). 

„ J]0,t]xE 

We then define g{s,x) := X)a<7 ■^)' ^^^^ again being a disjoint sum. As 
there are almost surely finitely many jumps up to time t, and g" is zero for a 
greater than the index of the next jump, for almost all w this is a finite sum, 
and so we can exchange the order of integration and summation. □ 

This martingale representation theorem has a simple interpretation, as it is 
based purely on the compensated indicator functions of the state of the under- 
lying process X . However, it has a significant fiaw for our purposes, as iterated 
integrals are not necessarily orthogonal. For this reason, we need to rescale q, 
for which we need the following assumption. This assumption poses the only 
restriction on the processes we shall consider. 

Assumption 1. For all a, there exists a deterministic measure ^" on M+ x E 
such that p"{io,-,-) is almost surely equivalent to C", and such that ^"([0,t] x 
E) < oo for all t < oo. For simplicity, we shall assume that is continuous 
with respect to t. 
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Lemma 3. There exists a predictable function tp : fix ]R+ X E — )-]0, 1] such that 
for all measurable functions f, for all a € I, 



E 



/ 



/(w, s, x)ip{u!, s, x)p{u}, ds, dx) 



xE 



-xE 



Wse]T„,T^+i]f{^, s, x)]C{du, dx) 



Proof. Simply take 

'll}{uj,t,x) = ^/te]T„_i,T„ 



dC° 



dp"{uJ,;-) 



□ 



Definition 1. We shall denote by the signed measure q resettled by ip, thttt 



IS, 



q^{t. 



J](i,t\XJ 



ip{u}, s, x)q{u!, ds, dx). 



For simplicity, we may write V't.x for il){uj,t,x). 

Lemma 4. /// is q-integrable, then f-i/j^^ is q^-integrable and the two integrals 
agree. If f is predictable, then so is f ■ . 

Proof. This is clear as V' is predictable and for each w equals the Radon-Nikodym 

derivative dqi/j/dq. □ 

Using the previous lemma, we immediately see that our martingale repre- 
sentation theorem can be equivalently stated in terms of g^, rather than q. This 
will be preferable, as has significantly better orthogonality properties than 
q, and so we shall hereafter focus on q^. 

We now seek to understand the space of integrands which yield square in- 
tcgrable martingales, when integrated with respect to q^. As our martingale 
representation is not given by an orthonormal set of martingales, but rather 
by a random measure q^ with q^{t,A) and q^{t,B) correlated, we need to be 
careful in our definition of the appropriate space of integrands. 

Lemma 5. For all f,g such that J^^ ^^^^ f{t,x)q^{dt,dx) is square integrable 
( and similarly for g ), we have the isometry 



if,9) 



= E 

E 



R+xE 



f{t,x)q^{dt,dx) 



R+xE 



g{t,x)q^{dt,dx) 



fit, x)g{t, x)ipl^piu>, dt, dx) 



R+xE 



R+xE 



E [Ite]T^,T^+^]f{t,x)9{t,x)] Cidt,dx) 



We shall write 



— (/) f)qi, ■ 
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Proof. From [S], we know that the quadratic variation of q is given by p, as 
we have assumed that C", and hence p", is continuous in t. As is simply a 
rescaled version of q, this quickly establishes the first isometry. The second then 
follows by breaking up the integral into the intervals ]Ta,Ta+i], and extracting 
the sum. □ 

From this lemma, we can see that our use of the martingale random measure 
q^ is a slight generalisation of constructing a martingale representation using 
'normal' martingales, that is, martingales with predictable quadratic variation 
given by Lebesgue measure (see, for example, Emery [7]). Here we replace 
Lebesgue measure with an arbitrary deterministic measure C", which can vary 
in a, and we retain the presence of the jump space E. 



4 Chaos representation property 

From this point onwards, we will not restrict ourselves to this particular choice 
of martingale representation. In fact, there may be cases where an alternative 
martingale representation is available and more convenient. We shall simply 
make the following assumption. 

Assumption 2. We are in the setting described in Section \2.1[ and there exists 
a random measure m such that 

• Jjo t] dx) is a martingale for all predictable, sufficiently bounded 
functions f , 

• every square integrable martingale has a representation Jj^j ^j^^ /(i, x)m{dt, dx) 
for some predictable function f , 

• for all sufficiently integrable predictable f and g, 

{f,9)m :=IE 

= f E [lte]T^.T^^,]f{t,x)g{t,x)] C{dt,dx). 

for some family of deterministic measures C"- As before ||/||^ •= {fif)m- 

Under Assumption [Tl m — q^ satisfies these requirements. However, it may 
be convenient to take an alternative representation, particularly in cases when 
Assumption [T] does not hold. A simple example of this is when E posesses a 
group structure (e.g. when E is a. vector space). If E is discrete, for example, 
when we consider a countable-state Markov chain, then the representation based 
on p will often not satisfy Assumption [U as the previous state ^q_i is a null set 
of the measure p", however is stochastic, which often contradicts the equivalence 
with the deterministic measure (^". On the other hand, we could use a repre- 
sentation based on the fundamental processes 7r"(t,A) = It>Tal£.a-£,a-i&A (in 
the place of p"), that is, we use the indicator functions of the jumps themselves, 
rather than the indicator of the location after the jump. This representation 
(appropriately rescaled) will satisfy our assumption as soon as the set of possible 
values (occuring with rate > 0) for the ath jump is deterministic. 



f{t,x)m{dt^dx)\ j g{t,x)m{dt,dx) 

+xE J \Jr+xE 
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Using the martingale m, we now prove the existence of the Chaos represen- 
tation of a random variable. 

Definition 2. For two (stopping) times T,T' < oo, we shall write 

J'TxT' = -Ft n Tt' — 

and 



I 

Jo 



rTxT' 

{■)m{dt,dx) := / {■)m{dt,dx). 

J(]0,T]n]0,T'[)xE 

For simplicity, in place ofm{dt, dx) we may write dm, similarly drrii form{dti,dxi), 
dm2 for m{dt2, dx2), etc. and also d^" for C"{dt, dx), d(" for ("{dtijdxi), etc. 

Note that if r = oo, then L'^{J^txt) = L'^{J^t), as we have assumed J^oo- = 

T 

^ oo • 

Definition 3. Let k < oo, r < oo. Let {gi} be a family of measurable functions 
gi : Clx (IR+ x Ey — >• R. Then we define the k-fold iterated integral operator via 
the recursion 

lH{gi})=go+ r^\t\{9i-i{t,x,---)}U)dm, 

Jo 

with initial value I^(go) = ,9o- For simplicity, we write I^{{gi]) := 
With this definition, the first few terms of our integral operator are 



cT-lXt 



n{{9o}) 


= 90 


K{{9o,9i}) 


= 90 + 


n{{9i]U) 


= 90 + 


n{{9i}to) 


= 90 + 



J J \^ J '^^^ J '^^'^ I '^^^ 



The important point to notice is that the 'internal' integrals are taken only up 

to the preceding jump times in our sequence. 

We can now state a precursor to the chaos representation theorem, using the 
iterated integrals I. 

Theorem 3. Let Y s L'^{J^TkXT) for k < oo, and deterministic t < oo. Then 
there exists a sequence of deterministic functions {ffij^Li such that 

Y = l':{{gi}). 

Proof. First assume r < oo. We shall use induction, iterating in a < fc over the 
cases where Y e L'^{J^TaXr)- For the initial case, suppose Y e L'^[Tq). Then Y 
is a constant, soY = jP{g^) = g^ for some constant 5°. 

Suppose Y £ L'^{Tt^xt) and that the result holds for all Y' S L"^ (J'-j,, - 1 xt) 
for t < T. By the martingale representation theorem, Y has a representation of 
the form 

TaXT 



rlotXr 

Y = E[Y] + / g{uj,t,x)dm 
Jo 
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for some predictable function g with \\g\\m < oo. As g is predictable, for every 
{t,x) the random variable g{-,t,x) is (J^T„_iAt)-iiieasurable. As we have 

= E nite]T,.,,T,]~9'{t,x)]dC^ 

we know E[It^]T,j^i,T,j]9{t, x)"^] < oo C'^-a-s. for all j5 < a. Taking the sum 
over ^ < a, we see E[^(f,.T)^] < oo. Therefore g{t,x) S L'^{J^T^_ixt)- As we 
have supposed that the result holds on L'^{J^T„-ixt), we can find deterministic 

{9i''''\---)}?=o such that 

from which we define 

gi{t, X, • • • ) = 9^i- • • ) for i > 1; 9o = E[Y]. 
This yields the representation of Y, 

Y=in{9i}) = E[Y] + r"^\r\{9t^})dm. 
Jo 

By induction, the result is proven for Y e L'^{J^TkXr) for all k < oo. We now 
seek to let r ^ oo. This is easily done by the convergence of square-integrable 
martingales. For Y G X^(J"tJ, let Yr := E[y|j;], so that Yr- G L'^i^TkAr)- 
Therefore Yt- = l!^{{gj}) for some collection of functions {gj}- It is easy to 
verify that these functions are consistent, that is, gJ = gl on [0,t A t'[xE, 
and hence {gJ} can be taken to be independent of r. Therefore, by martingale 
convergence, 

Y ^ E[y|7-,_] = Yr- =X^(te}) ^ a.s. 
from which we see F = I^dfifj}). □ 

Remark 1. Intuitively, this representation in terms of l'^ has a simple inter- 
pretation. From the martingale representation theorem, we know we can write 
any J^t^xt = J^Tk n J>_ -measurable random variable in terms of the stochastic 
integral on [0,Tfc] fi [0,r[ of a predictable process gt- However, up to time Tk, 
a predictable process gt is J^T^_jxt-iiicasurable for each i, and so by induction 
can itself be written as an integral on [0, Tk-i] n [0, t[. Hence any T^-measurable 
random variable can be written as the iterated stochastic integral, where each 
integral is at most up to an earlier jump time. 

We can now construct the chaos representation. 
Definition 4. For T <oo a stopping time, we shall write 

, S2i Sji ) : < s„ < Sn-i < ... < Si < T} C [0, T]" 
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For T a stopping time, we define the n-fold iterated integral 



Jrig) ^ I gi{{sk,Xk)})Q^m{dsk,dxk) 

/ / ... / g(...)dm„_i 
10 Jo Jo Jo 

For convenience, J^ig) .9 for all constants g. 

Definition 5. For T a stopping time, let 



. dm2 dmi 



span{J^(.g) : E[{J^{g)f] <oo,n< m}, 



the L^(V)-closure of the span of the square integrable iterated stochastic integrals 
of order at most m up toT . This is a Hilbert space, with the same inner product 
as L^(V). 

We can now prove the the Chaos representation theorem for random vari- 
ables known after finitely many jumps. 

Theorem 4. For any k < oo, we have H!^^ = L'^{J^Tk)- 

Proof. Clearly H!^^ C Lp{J^Tk)i aiid Ht^^ is a Hilbert subspace. Therefore, either 
H!^^ — L'^{J^Tk) or there exists a nonzero random variable Y S Lp{FTk) which 
is orthogonal to every element of H^^ . 

By Theorem [21 the space spanned by the iterated integrals is L'^{J-t^.)- 
Hence Y has a representation of the form Y = l'^{{gi}), for some functions 
{gi}- We seek to show that gi — for all i on the relevant range of integration. 
We shall do this using induction, however due to notational complexity, we shall 
simply write out the first three steps, the rest follow in the same manner. 

For go, note that we must have 



= E[yjO (5o)] 



9l 



9l 



go 



.goit 



rk-l/ 



■t i{g^-l(t,x,■ 
[ \t\{g^-l{t,x, 

Jo 




and we see go = 0. 

For (7i, note that as go = 0; we know 



Y 



ItH{g^-l{■■■)})dm, 



{gi{ti,xi) + C{ti,xi))dmi. 



where ^(^1,2:1) = 



n-ixti ^k-2 



({51-2(^1, a;i, • • • )})dm2- Note that x)] 
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0. Then 



= E[Fji^(.gi)] 

E I / {gi{ti,xi) + ^{ti,xi))dTni 



Ti 



\lu<T,gi{ti,xi)C + Y, I 1 
„, Jo 



gidmi 
'({ti,xi))]gi{ti,xi)dC 



\\Iti<n9i{ti,xi 



and so gi{ti,xi) = on [OjTfe] (up to a set of C"-measure zero for all relevant 
a < k). 

For g2i note that as go = 5i = 0, we know 



Y = 



Jt) 

Tk pTk-iXti 



rfc-2 



{{gi-2{- ■ ■ )})dm2dmi 



{g2{ti.,xi,t2, X2) + ^{ti,xi,t2, X2))dm2dmi 

'0 Jo 

where E[^(...)] = 0. Hence, expanding in the same way as above 
= E[yj2^(.g2)] 

' rTk-iXtt 



E 

a<k 



EE 

a<fc/3<a 



E 



Itie]To,-i,T^ 
00 i^ti 



g2(ti,xit2,X2)dm2 



^0 



E[It,e]T^-uT^]It2e]Ti,_^,T,3]]{g2{tl,Xi,t2,X2)fdC^dCi 



and so 52 = up to a set of measure zero, on its relevant domain. 

Continuing the induction, we see that gi = for all i < k. Therefore 
Y = 0, and there is no element of L'^{FTk) orthogonal to all of i?Tfc- Therefore 
the spaces coincide. □ 

Finally, we can expand our Chaos representation theorem to all of L?{T). 

Theorem 5. Any square integrable random variable can be arbitrarily well ap- 
proximated in by a sum of iterated integrals, or equivalently, 



Proof. We shall again use the convergence of square integrable martingales. For 
any Y G L^(J^), let Yfc — E[y|7^Tfc]- This is a martingale in the discrete filtration 
Qk = J-Tk I and so Yjt — ?> y in L^. Hence for any e > there exists a k such that 
E[(y — Yfe)^] < e/4. By Theorem H] there is also a sequence {gn\n=i such that 



Yk-T.LoJTki9n. 



< e/4. By the triangle inequality, 



E 



Y-T.JTki9n)] 
\ i=l / 



< e. 



□ 
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5 Conclusions 



We have shown general conditions such that an arbitrary marked point process 
generates a martingale random measure m for which a martingale representation 
theorem holds, and such that L^{J-) admits a chaos decomposition. 

A key motivating application of this result is to allow a general development 
of Malliavin calculus for marked point processes. This development is done in 
[3], under the assumption that a chaos decomposition exists. 

The only assumptions that we have made on the processes in question is that 
the compensating measure is equivalent to some deterministic measure 
which is continuous in time and finite for finite times. It seems reasonable that 
some relaxation of this assumption is possible, for example, to only assuming 
that is absolutely continuous with respect to ■ The difficulty in doing this 
arises as we cannot then write the quadratic variation of a martingale in terms 
of a product measure T x and therefore cannot directly show that iterated 
integrals of different orders are orthogonal. 

It also seems reasonable that a relaxation of the assumption that there are 
finitely many jumps should be possible. In [4, no such assumption is made, 
however this leads to the need for transfinite induction in the proof of the 
martingale representation theorem. Having convergent sequences of jumps also 
requires a relaxation of the continuity of p in time (which we assume through the 
equivalence of and ^" , coupled with the continuity of ) . This may also be 
possible, however it leads to a more complex quadratic variation for stochastic 
integrals, as it allows the possibility of accessible jump times. 
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